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0 Multidimensional systolic array processing apparatus and method. 

© A multidimensional systolic array processor uses a multidimensional array of systolically coupled processing 
elements to perform matrix-vector multiplication of matrix and vector signal sets. A two-dimensional array uses a 
PxQ matrix (P rows and Q columns) of processing elements which are coupled to systolically process the 
signals, e.g. via multiplication and accumulation, the processing elements are coupled both row-to-row and 
column-to-column for pipeline processing within each row and each column, i.e. multidimensional pipelining, 
thereby increasing processing parallelism and speed. Interconnectivity of the processing elements is minimized 
by forming separate column and row signal subsets of the vector signal set which are coupled simultaneously to 
each processing element in the first row and first column, respectively. Size of the processing elements is 
minimized by reducing local storage of matrix signal subsets within each processing element. Separate column 
and row signal subsets of the matrix signal set are formed and coupled into each processing element of the first 
row and first column, respectively. As the matrix column and row signal subsets are systolically processed and 
transferred row-to-row and column-to-column, respectively, each signal subset is reduced in size by one signal, 
thereby requiring the transfer and temporary local storage of successively smaller matrix signal subsets. A three- 
dimensional processor uses a PxQxT array (T planes of P rows and Q columns) of processing elements which 
are coupled plane-to-plane-to-plane. 
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The present invention relates to array processors, and in particular, to systolic array processors which 
process multiple signals in parallel in multiple dimensions. 

Systolic processors, i.e. processors which systolically "pump," or transfer, data from one processing 
element to another, are well known in the art. Systolic arrays have been used to increase the pipelined 
5 computing capability, and therefore the computing speed, of various types of signal processors. 

Systolic array processors are particularly useful for processing, e.g. multiplying, two signal sets, where 
the first signal set represents a matrix parameter set and the second signal set represents a vector 
parameter set. In other words, the first signal set represents a matrix parameter set which can be 
represented as an M-by-K ("MxK") matrix having M rows and K columns of parameters, and the second 
10 signal set represents a Kx1 vector having K rows and 1 column of parameters. 

Referring to Figure 1, a representation of the matrix-vector multiplication of two such signal sets can be 
seen. The matrix signal set W has matrix signals W l(J and the vector signal set V has vector signals V J( 

where I is an element of the set {1,2,3 M} and J is an element of the set {1,2,3 K}, This can be 

expressed mathematically by the following formula: 

75 
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Such signal sets are also found in many artificial neural network models, including the Hopfield neural 
network model. Referring to Figure 2, a simple artificial neural network with its associated signal sets can be 
seen. The first layer of neurons n u , or nodes, receives some form of input signals lj, and based thereon, 
generates a number of voltage signals Vj, which can be represented as a voltage vector V. 

Coupling the respective voltage signals Vj to the second layer of neurons n 2 ,, are a number of scaling 
elements (e.g. "adaptive weights"), which introduce scaling, or "weight," signals W u for scaling or 
"weighting" the voltage signals Vj prior to their being received by the second layer neurons n 2t ,. It will be 
understood that, with respect to the subscripted notation for representing the scaling or weighting signals 
W u , the first subscripted character "I" represents the destination neuron n 2i , in the second layer, and the 
second subscripted character "J" represents the source neuron n 1tJ of the voltage signal Vj in the first 
layer. 

The simplest form of systolic processing array used for performing the matrix-vector multiplication of 
signal sets, as discussed above, is one<iimensional. One type of one-dimensional systolic array is a "ring" 
systolic array, shown in Figure 3. The systolically coupled processing elements Nj are interconnected as 
shown, with signal flow represented by the arrows. First, the corresponding voltage signals Vj are initially 
coupled into their corresponding processing elements Nj. Then, following the application of each clock 
pulse (not shown, but common to each processing element Nj), the matrix signals W w are sequentially 
inputted to their corresponding processing element Nj, as shown. Therein, each matrix signal W u is 
multiplied by its corresponding voltage signal Vj and accumulated, i.e. stored, within the processing 
40 element Nj. 

Following the next clock signal, the foregoing is repeated, with the voltage signals Vj being transferred 
to subsequent processing elements Nj to be multiplied by the corresponding matrix signal W u therein. For 
example, the voltage signals Vj which are transferred between the processing elements Nj are shown in 
parentheses. This is repeated K-1 times, i.e. for a total of K times, to produce the final matrix-vector product 

45 outputs 0,. The "ring" configuration facilitates multiple iterations of the matrix-vector products, a desirable 
feature used in the learning phase of an artificial neural network. Further discussions of the ring systolic 
array can be found in "Parallel Architectures for Artificial Neural Nets," by S.Y. Kung and J N Hwang 
IJCNN 1989, pp. 11-165 through 11-172. 

A second type of one-dimensional systolic array relies on a configuration in accordance with the 

so "STAMS" (Systematic Transformation of Algorithms for Multidimensional Systolic arrays) technique. The 
STAMS technique is discussed in detail in "Algorithms for High Speed Multidimensional Arithmetic and 
DSP Systolic Arrays." by N. Ling and M.A. Bayoumi, Proceedings of the 1988 International Conference on 
Parallel Processing, Vol. I, pp. 367-74. An example of a oneKiimensional STAMS systolic array is shown in 
Figure 4. 

55 First, just as in the ring systolic array of Figure 3, the voltage signals Vj are initially inputted into their 
respective processing elements Nj. Then, the matrix signals W, tJ are inputted into the processing elements 
Nj, with each respective processing element Nj receiving one column of the matrix of matrix signals W w , 
as shown. The weight-voltage products are summed with the corresponding weight-voltage products from 
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the preceding processing element Nj., and then systolically transferred to the next processing element 
N J+1 , and the process continues. 

The inputting of the matrix signals W u into each successive processing element Nj is delayed by one 
additional clock pulse per processing element stage to allow for the delays associated with the systolic 

5 transferring of the accumulated products. This delay can be accomplished by inputting zeros to a 
processing element Nj until the systolically transferred accumulated products begin to arrive. However, this 
delay adversely affects the processing speed. As compared to the ring systolic array of Figure 3 which 
requires K clock cycles, the STAMS systolic array requires 2K-1 clock cycles to obtain the product outputs 
Q of this matrix-vector multiplication. 

w A number of problems are associated with using these one-dimensional systolic arrays. One problem 
involves the inputting of the voltage signals Vj. If the voltages Vj are to be loaded simultaneously in parallel, 
global interconnects are required to accomplish this. If they are to be loaded sequentially in serial, 
numerous local interconnects are required, as well as K clock cycles. 

Another problem involves the inputting of the matrix signals Wj,j. If the matrix signals W u are stored 

75 locally within each processing element N J( the processing elements Nj must be large enough to provide 
sufficient storage, i.e. memory, therefor. On the other hand, if the matrix signals W u are not stored locally 
within each processing element Nj, but instead inputted as needed, the global interconnections necessary 
to do this become complex and impractical. Either many parallel input lines, e.g. a wide signal bus 
structure, or a large number of clock cycles must be provided. 

20 A third problem involves the amount of time required to perform the matrix-vector multiplication, i.e. 2K- 
1 clock cycles for the STAMS systolic array. Although the ring systolic array requires only K clock cycles, 
the problem remains, as discussed immediately above, of providing either sufficient local matrix signal 
storage or complex global interconnections. 

One approach to addressing these problems of interconnects, storage area and processing time 

25 involves the use of multidimensional systolic processing arrays. For example, parallelism, i.e. parallel 
processing, can be introduced by subdividing the matrix signals W u and vector signals Vj. This can be 
diagrammatically visualized as seen in Figures 5A-5B. This can be expressed mathematically by the 
following formula; 

30 

P-l Q-l 

°I ™ Z E W I t 0E*F*1 V 0£*F*1 

E=0 F=0 

35 Each row I of the matrix W is divided into P groups of Q signals W u . In other words, the first of the P 
groups of Q signals W u contains the matrix signals W 1t1 -W 1iQ . Similarly, the vector V is divided into P 
groups of Q voltages Vj. For example, the first of the P groups of Q voltages Vj includes the voltages Vi- 
V Q , This can be visualized in even simpler form as shown in Figure 5B. 

The processing of these P groups of Q signals W u , Vj can be accomplished by using several one- 

40 dimensional STAMS systolic arrays, such as that shown in Figure 4, in parallel, as shown in Figure 6A. The 
operation of each separate systolic array is in accordance with that described for the one-dimensional 
STAMS systolic array of Figure 4 above, with the exception that only Q, rather than K, processing (i.e. 
clock) cycles are required for each systolic array to complete one subproduct. The subproducts of each 
array are then summed together to provide the final product outputs Q. Visualizing this systolic array 

45 configuration as two-dimensional is perhaps more easily done by referring to Figure 6B. 

This two-dimensional systolic array configuration is an improvement over the one-dimensional STAMS 
configuration, with respect to processing time. Processing time is reduced since each one-dimensional 
array, i.e. each pipeline of processors, within the two-dimensional array is shorter and more processing is 
done in parallel. This configuration requires only K+ Q-1 clock cycles to obtain the product outputs Oi of the 

so matrix-vector multiplication. 

Further improvement has been achieved by extending the two-dimensional STAMS systolic array of 
Figure 6A to a three-dimensional systolic array. This can be done by further subdividing the matrix W and 
vector V signals into T groups of P groups of Q signals W )(J , Vj. This can be visualized diagrammatically by 
referring to Figures 7A-7B. This can be expressed mathematically by the following formula: 

55 
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T-1 P-l Q-l 
°l = Z E L W I,POG+0£*F+1 V POG+0€+F+1 

G=0 E=0 F=0 

As seen in Figure 7A, each row I of the matrix W and the vector V is divided into T groups, which in 
turn are divided into P groups of Q signals W u , Vj. For example, the first of the P groups within the first of 
the T groups contain the matrix signals W 1a i-W 1(Q and the vector signals Vi-V Q . Figure 7B represents a 
more simplified depiction of this multiple subdivision of the matrix W and vector V signals. 

Referring to Figure 8A, a realization of such a three-dimensional systolic array is illustrated. Two- 
dimensional systolic arrays, similar to that illustrated in Figure 6A, are disposed as if on T parallel planes. 
The operation of each of the T two-dimensional systolic arrays is similar to that as described above for 
Figure 6A. The subproduct outputs of each of the T two-dimensional arrays are summed together to 
produce the full product outputs Q. The three-dimensional nature of this array can perhaps be better 
visualized by referring to Figure 8B. 

This three-dimensional STAMS systolic array configuration is an improvement over the two-dimensional 
configuration inasmuch as fewer processing, i.e. clock, cycles are required to complete each product output 
0|. Processing time is reduced since each one-dimensional array, i.e. each pipeline of processors, within 
each plane of two-dimensional arrays is shorter and more processing is done in parallel. This three- 
dimensional configuration requires only T + K-1 clock cycles. 

Even though the two-dimensional and three-dimensional STAMS systolic array configurations discussed 
above provide improvements with respect to processing speed, minimal if any improvement is provided 
with respect to the number and complexity of the local or global interconnections required for inputting the 
matrix W and vector V signals. Furthermore, even though the one-dimensional ring systolic array already 
provides reasonable processing speed, its requisite global interconnections are complex and impractical. 
Moreover, no improvements are provided by any of the foregoing arrays with respect to matrix signal W ( j 
storage requirements. 

Moreover, the two- and three-dimensional STAMS systolic array configurations described above are not 
truly two- or three-dimensional, respectively. The two-dimensional array, as well as each two-dimensional 
array plane within the three-dimensional array, have their processing elements N A , B interconnected along 
one dimension only, e.g. left to right. Therefore, the systolic processing actually occurs in one dimension 
only. Thus, full multidimensional parallelism or pipelining is not achieved and maximum processing speed, 
i.e. minimum processing time, cannot be achieved. 

It would be desirable to have a true multidimensional systolic array configuration providing true 
multidimensional pipeline operation to maximize processing speed. It would be further desirable to have 
such a multidimensional systolic processing array in which minimal global or local interconnects are 
required for inputting the matrix and vector signals. It would be still further desirable to have such a 
multidimensional systolic processing array with minimal matrix signal storage requirements for each, 
processing element. 

The present invention addresses these objects and is defined by the independent claims. 

A multidimensional systolic array processor in accordance with the present invention has an architec- 
ture which maximizes processing parallelism and minimizes global interconnections. Further, the present 
invention minimizes local matrix signal storage requirements within each processing element. 

The present invention maximizes processing parallelism by interconnecting its processing elements 
along multiple dimensions. Therefore, systolic processing occurs along multiple dimensions. For example, a 
two-dimensional systolic array processor in accordance with the present invention includes a PxQ matrix 
having P rows and Q columns of processing elements, each of which is systolically coupled row-to-row and 
column-to-column for full pipeline processing within each row and each column. A three-dimensional 
systolic array processor has a PxQxT array with T planes of P rows and Q columns of processing elements, . 
each of which is systolically coupled plane-to-plane-to-plane for full pipeline processing. 

The present invention minimizes global interconnections of the processing elements. For the two- 
dimensional case, appropriate matrix and vector signal subsets are inputted to only one row and one 
column of the two-dimensional processing array. These matrix and vector signal subsets are specifically 
formed so that they need to be inputted to only one row and one column, and yet still be properly 
processed systolically along all dimensions within the array. 

For the three-dimensional case, appropriate matrix and vector signal subsets are inputted to three 
perpendicular planes of the three-dimensional processing array. For higher-dimensional cases, appropriate 
matrix and vector signal subsets are similarly inputted to the higher-dimensionaJ processing arrays. 
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The present invention minimizes local matrix signal storage requirements by inputting specifically 
formed matrix signal subsets to only one row and one column of the two-dimensional processing array, and 
to three perpendicular planes of the three-dimensional processing array. These matrix signal subsets are 
formed to allow the sizes of the matrix signal subsets to be reduced as they are systolically transferred to 
subsequent processing elements along each dimension within the array. As the matrix signal subsets 
decrease in size through the array, the local storage, e.g. memory, needed for temporarily storing each 
matrix signal subset within each processing element is successively reduced. Processing speed is not 
sacrificed since the matrix signal subsets are transferred to the subsequent processing element at a clock 
rate higher than that used for systolically transferring the vector signal subsets. 

These and other objectives, features and advantages of the present invention will be understood upon 
consideration of the following detailed description of the invention ana" the accompanying drawings. 

Figure 1 illustrates diagrammatically a conventional matrix-vector multiplication. 

Figure 2 illustrates a simple conventional two-layer artificial neural network. 

Figure 3 illustrates a conventional one-dimensional "ring" systolic array. 

Figure 4 illustrates an alternative conventional one-dimensional systolic array. 

Figures 5A-5B illustrate diagrammatically a conventional matrix-vector multiplication, wherein the matrix 
and vector are subdivided into matrix and vector subsets, respectively. 

Figures 6A-6B illustrate a conventional quasi two-dimensional systolic array. 

Figures 7A-7B illustrate diagrammatically a conventional matrix-vector multiplication, wherein the matrix 
and vector of Figures 5A-5B are further subdivided into matrix and vector subsets, respectively. 
Figures 8A-8B illustrate a conventional quasi three-dimensional systolic array. 

Figure 9 illustrates the Layer 1 and 2 neurons of Figure 2 reconfigured as two-dimensional neural arrays 
in accordance with the present invention. 

Figure 10 illustrates diagrammatically the reconfiguration of the, one-dimensional vector signal set of 
Figure 1 into a two-dimensional vector signal set in accordance with the present invention. 

Figure 11 illustrates diagrammatically the matrix-vector multiplication of the matrix and vector column 
signal subsets in accordance with the present invention. 

Figure 12 illustrates diagrammatically the matrix-vector multiplication of the matrix and vector row signal 
subsets in accordance with the present invention. 

Figure 13 illustrates a block diagram of a two-dimensional systolic array processor in accordance with 
the present invention. 

Figure 14 illustrates a single processing element of the two-dimensional processor of Figure 13. 
Figure 15 illustrates a functional block diagram of a single processing element of the two-dimensional 
processor of Figure 13. 

Figure 16 illustrates the reduced local matrix signal storage requirements of the two-dimensional 
processor of Figure 13. 

Figure 17 further illustrates the reduced local matrix signal storage requirements of the two-dimensional 
processor of Figure 13. 

Figure 18 illustrates a block diagram of a three-dimensional systolic array processor in accordance with 
the present invention. 

Referring to Figure 9, the Layer 1 and 2 neurons n )t m of an artificial neural network (as shown in 
Figure 1) are reconfigured into two-dimensional neural arrays. The original input signals lj now have double 
subscripted notation to reflect the two-dimensional set of input signals k^. Similarly, the original voltage 
signals Vj now have double subscripted notation to reflect the two-dimensionality of the set of voltage 
signals V Yi2 . Indicated in brackets for some of the Layer 1 neurons in Figure 9 are the original Layer 1 
neuron and voltage identifiers (the remaining identifiers being left out for clarity). 

The Layer 2 neurons also now have double subscripted notation to reflect the new two-dimensionality of 
the set of Layer 2 neurons n^e. Indicated in brackets for some of the Layer 2 neurons are the original Layer 
2 neuron identifiers (the remaining identifiers being left out for clarity). 

The original matrix, e.g. "weight," signals W u now have quadruple subscripted notation to reflect their 
new multidimensionality, i.e. W AiB; y t2 . The first subscripted pair of characters "A.B" represents the destina- 
tion neuron n^B in the second layer. The second subscripted pair of characters "Y,Z" represents the source 
of the voltage signal V Y , Z in the first layer. Indicated in brackets for some of the matrix signals W AiB ; Yi z are 
the original matrix signal identifiers W u (the remaining identifiers being left out for clarity). 

It should be understood that the representations of the Layer 1 and 2 neurons, along with their 
subscripted notations, were selected arbitrarily. They can be reconfigured as desired, provided that the 
resulting subscripted notation for the matrix signals be consistent therewith. 

It should be further understood that it has been assumed for the sake of simplicity that M = K for the 
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reconfigured array of Layer 2 neurons as represented in Figure 9. However, this is not necessary to the 
present invention. Ideally, the numbers of rows and columns should be equal, i.e. P = Q. This is to maximize 
the improvements in processing speed and to minimize the local matrix signal storage requirements in 
accordance with the present invention. However, if K cannot be expressed as a square, i.e. if P*Q, then the 
5 numbers of neurons in both Layers 1 and 2 can be approximated to the nearest square. Extra processing 
cycles would be required because of such an approximation, but significant improvements in processing 
speed and local matrix signal storage requirements would still be realized. 

Referring to Figure 10, the reconfiguration of the one-dimensional vector signal set Vj of Figure 1 into a 
two-dimensiona] vector signal set V YrZ can be understood. The one-dimensiona! vector signal set Vj is 
70 initially mapped into a two-dimensional vector signal set with the original subscripted notation left intact. 
This two-dimensional vector signal set is then given new double subscripted notation to reflect the two- 
dimensionality of the reconfigured vector signal set V Y(2 . 

Also indicated in Figure 10 (with dashed lines within the two-dimensional vector signal sets) are two 
vector signal subsets. One is referred to as the vector column signal subset V c and the other is referred to 
75 as the vector row signal subset V R . These vector signal subsets V c , V R are multiplied by the matrix signals 
W a ,b; Y ,z, as represented in Figure 9. The matrix signals W AtB;YiZ are separated into corresponding matrix 
column W c and row W R signal subsets. The vector column V c and row V R signal subsets are multiplied by 
the matrix column W c and row W R signal subsets, respectively, as shown in Figures 11 and 12. Therefore, 
the matrix-vector products 0, are identified according to the following formulas: 

20 

01 = O c + Or 
where: 

25 

Q P 
Z=l Y=X 

Z 

so J = Y-Z-P + £(P-Z+2) 

Z=l 

X = Z, for odd Z 

= Z + 1 , for even Z; 

35 and 



45 



P Q 

PR - I E W A# B;y ( 2Vj 

Y=l Z=X 

Y 

J = Z-Y-Q + £(Q-Y+2) 
Y-l 



X = Y, for even Y 

= Y+1,for odd Y. 



= Y+1,for odd Y. 

Based upon the foregoing, the vector V c , V R and matrix W c , W R signal subsets can be identified 
according to the following formulas: 



so V c = V YiZ = Vj 
W c = W A>B;YtZ 
where: 



55 
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Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 



Z = 1,2,3,...,Q 

Y = X,X + 1,X + 2,...,P 

X = Z, for odd Z 

= Z + 1 , for even Z; 

10 and 

V R = V Yi2 = V Jr 
W R = W AiB . YtZ 
where: 



75 



Y 

20 J - Z-Y-Q + £ (Q-Y+2) 

' Y=l 

Y = 1,2,3,...,P 
Z = X,X + 1,X + 2,...,Q 
25 X = Y, for even Y 

= Y + 1,forodd Y. 

Referring to Rgure 13, a two-dimensional systolic processing array 100 in accordance with the present 
invention includes K processing elements 102, designated by N AiB where A is an element of the set 
f 1 ' 2 ' 3 p >. B is an element of the set {1,2,3 Q} and K = PG. The processing elements 102 are 

30 interconnected in a two-dimensional matrix 100 having P rows and Q columns. 

The processing elements 102 are mutually coupled column-to-column via matrix row subset signal lines 
104 and vector row subset signal lines 106. These signal lines 104, 106 provide the means by which the 
matrix W R and vector V R row signal subsets are systolically transferred column-to-column among the 
processing elements 102. The processing elements 102 are further mutually coupled row-to-row via matrix 

35 column subset signal lines 108 and vector column subset signal lines 110. It is by these signal lines 108, 
110 that the matrix W c and vector V c signal subsets are systolically transferred row-to-row among the 
processing elements 102. 

All processing elements 102 in the first row 112 receive a vector signal input 114 which is a vector 
column signal subset V c of the vector signal set V. Ail processing elements 102 in the first row 112 further 

40 receive a matrix signal input 116 which is a matrix column signal subset W c of the matrix signal set W. 

All processing elements 102 in the first column 118 receive a vector signal input 120 which is a vector 
row signa! subset V R of the vector sijgnal set V. All processing elements 102 in the first column 118 further 
receive a matrix signal input 122 which is a matrix row signal subset W R of the matrix signal set W. 

All processing elements 102 within the matrix 100 further receive two clock signals. The first clock 

45 signal, a multiply-accumulate ("MAC") clock 124, initiates and provides the timing for the multiply- 
accumulate operation (discussed more fully below) within each processing element 102. The second clock 
signal, a weight transfer ("WT") clock 126, initiates and provides the timing for the transfer of the matrix, 
e.g. weight, signals W u among the processing elements 102 (discussed more fully below). 

The vector column signal subset V c is inputted in parallel to ail processing elements 102 within the first 

so row 112, one signal at a time in accordance with the MAC clock 124. As each signal of this signal subset V c 
is inputted, the corresponding signals in the matrix column signal subset W c (according to the formula given 
above) are also inputted to the processing elements 102 within the first row 112. The number of signals 
from the matrix column signal subset W c which are inputted with each signal of the vector column signal 
subset V c is P, one for each of the processing elements 102 in each column (discussed more fully below). 

55 Similarly, the vector row signal subset V R is inputted in parallel to all processing elements 102 in the 
first column 118, one signal at a time in accordance with the MAC clock 124. Inputted in parallel therewith 
are the corresponding signals from the matrix row signal subset W R (according to the formula given above). 
The number of these corresponding signals within the matrix row signal subset W R is Q, one for each 
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processing element 102 within each row (discussed more fully below). 

As discussed further below, the matrix W c and vector V c column signal subsets and matrix W R and 
vector V R row signal subsets are multiplied simultaneously and then added in each processing element 102. 
After completing the matrix-vector subproducts and accumulation thereof for the first column and row 
signals of the column W C) V c and row W Rl V R signal subsets, this process is repeated for the second 
column and row signals. However, as discussed further below, the matrix column W c and row W R signal 
subsets each contain fewer signals following each multiplication and accumulation. 

The number of signals to be transferred within each matrix column W c or row W R signal subset is 
greater than the corresponding signal in the vector column V c or row V R signal subset, respectively. 
Therefore, the row-to-row or column-to-column transferring of the matrix column W c and row W R signal 
subsets should be done at a higher rate than the corresponding transfer of the vector column V c and row V R 
signal subsets, respectively. Thus, the WT clock 126 operates at a higher frequency than the MAC clock 
124. 

The rate of the WT clock 126 is the greater of either P- or Q- times that of the MAC clock 124. It will be 
understood that this provides for transferring all corresponding matrix signals W c , W R (P signals from the 
matrix column signal subset W c , and Q signals from the matrix row signal subset W R ) "simultaneously" with 
their corresponding vector signal subsets V c , V R . Processing speed is not sacrificed for this, since the 
multiply-accumulate operation performed on each vector signal subset V c , V R requires more time than the 
mere transfer of one matrix signal W )fJ to the next processing element 102. 

Referring to Figure 14, a single processing element Na, b representative of all processing elements 102 
within the matrix 100 is illustrated. As discussed above, input signals 104a, 106a, 108a, 110a include the 
matrix W R and vector V R row signal subsets, and matrix W c and vector V c column signal subsets which are 
systolically transferred from prior processing elements 102 in the preceding column and row, respectively. 
Further input signals, as discussed above, include the MAC clock 124 and WT clock 126. 

Output signals 104b, 106b, 108b, 110b include the matrix W R and vector V R row signal subsets, and the 
matrix W c and vector V c column signal subsets which are systolically transferred to subsequent processing 
elements 102 in the next column and row, respectively. As discussed more fully below, the output matrix 
W R , W c signal subsets 104b, 108b contain fewer members, i.e. signals, than their corresponding input 
matrix W R , W c signal subsets 104a, 108a. Another output signal 128 is the matrix-vector subproduct signal 

The two-dimensional operation of the systolic processing array 100 in accordance with the present 
invention, as shown in Figure 9, is substantially faster. It can be shown that the total processing, e.g. 
computation, time is P(P + 1)/2-(P/2) + P cycles (i.e. of MAC clock 124). This is substantially faster than the 
quasi two-dimensional array of Figure 6A discussed above. Mathematically, the improvement in processing 
speed can be expressed by the following formula: 



rP(P+lW2-(P/2)+P1 
Q+K-l 

For example, if P = Q= 10 (and therefore K= 100), the quasi two-dimensional array of Figure 6A requires 
Q + K-1 =10 + 100-1 ='109 cycles. The array 100 of the present invention, however, only requires 10(10 + 1)- 
/2-(l0/2) + 10 = 60 cycles. As the array 100 size increases, i.e. as P and Q become greater, the improvement 
in processing speed of the present invention is enhanced further. It can be shown that this improvement 
becomes enhanced by as much as 50% over that of the quasi two-dimensional array of Figure 6A. 

Referring to Figure 15, the operation, e.g. multiply-accumulate (MAC) function, of each processing 
element 102 can be understood. The matrix W R , W c signal subsets are inputted and stored in matrix 
storage elements 204, 208 (e.g. memory circuits or registers). The corresponding vector V R , V c signal 
subsets are inputted and selectively stored in vector signal storage elements 206, 210 (e.g. memory circuits 
or registers). The corresponding matrix W c and vector V c column signals are then multiplied, as are the 
corresponding matrix W R and vector V R row signals in multipliers 212, 214. It should be understood that the 
vector V R , V c signal subsets need not necessarily be stored, but instead can be inputted directly into their 
respective multipliers 212, 214. 

The resulting matrix-vector subproducts are then summed together in an adder 216. It will be 
recognized that this multiplication and summation can be done with digital multipliers and adders, or 
alternatively, a microprocessor can be programmed to perform this. The remaining matrix W R , W c and 
vector V R , V c signal subsets are then systolically transferred to subsequent processing elements 102. 

Referring to Figure 16, the systolic transferring and local storage of successively smaller groups of 
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signals from the matrix column signal subset W c can be understood. As discussed above, the matrix 
column signal subset W c initially has P members, i.e. signals, for each corresponding signal from the vector 
column signal subset V c . These corresponding matrix W c and vector V c signal subsets are then transferred 
to the second processing element N 2il in the first column 118 via the matrix 108 and vector 110 column 
subset signal lines. 

However, as discussed above for Figure 11, the first of the signals within the matrix column signal 
subset W c corresponding to the inputted signal from the vector column signal subset V c has already been 
processed and is no longer needed. Therefore it need not be transferred, i.e. only P-1 signals of the matrix 
column signal subset W c need to be transferred to the second processing element N 2(1 . Therefore, whereas 
the storage registers, e.g. memory, within the first processing element N ti1 must be large enough to store P 
matrix signals, the corresponding registers within the second processing element N 2il need only be large 
enough to store P-1 matrix signals. 

Similarly, the third processing element N 3il need only store P-2 matrix signals, and so on. This 
continues until the last processing element N P(1 which need only contain enough storage area to store one 
matrix signal. Thus, it can be seen that local storage requirements for the matrix column signal subsets W c 
for all processing elements 102 within the first column 118 total P(P + 1)/2 storage registers. Since each of 
the Q columns of processing elements 102 are identical, total storage requirements for the full array 100 for 
the matrix column signal subsets W c are QP(P + 1)/2 storage registers. 

Referring to Figure 17, the reduced local storage requirements for the matrix row signal subsets W R can 
similarly be understood. As discussed above, corresponding signals from the vector V R and matrix W R row 
signal subsets are inputted into each processing element 102 in the first row 112 of the array 100. As the 
vector row signal subset V R is systolically processed and transferred column-to-column through the array 
100, its corresponding matrix row signal subset W R is transferred therewith. 

However, as discussed above, the number of corresponding signals within the transferred matrix row 
signal subset W R is reduced by one signal with each systolic processing cycle and transfer. For example, 
the first processing element N u in the first row 112 of processing elements 102 receives a signal from the 
vector row signal subset V R , and a corresponding group of signals from the corresponding matrix row signal 
subset W R , which has Q members, i.e. signals. After processing by the first processing element N 1(1 , the 
first matrix signal within the matrix row signal subset W R is no longer needed, and therefore need not be 
transferred to the second processing element N 1(2 . Thus, only Q-1 signals of the matrix row signal subset 
W R are transferred and stored within the second processing element N 1i2 . 

This continues to be true as the vector V R and matrix W R row signal subsets are systolically processed 
and transferred column-to-column through the array 100. Thus, the last processing element N 1Q need 
provide local storage registers for only one signal from the matrix row signal subset W R . 

Based upon the foregoing, it can be shown that the total local storage requirements for all processing 
elements 102 within each row are Q(Q + 1)/2 storage registers. Including all P rows of processing elements 
102, the total local storage requirements for storing the matrix row signal subsets W R are PQ(Q + 1)/2 
storage registers. 

Therefore, it can be shown that for the case of P = Q and K = PQ, the total local storage requirements for 
both the matrix column W c and row W R signal subsets are P 2 (P + 1) storage registers. This represents a 
significant improvement over the local storage requirements of the quasi two-dimensional array of Figure 
6A. For example, for the case of P = Q and K = PG, local matrix signal storage requirements are reduced 
approximately by a factor of P, or more precisely, according to the following formula: 

PQfP+ii = p^p+d/p 4 = (p+ij/p 2 
(PQ) (PQ) 

It should be understood that the foregoing principles of a two-dimensional systolic array in accordance 
with the present invention can also be extended to a three-dimensional systolic array. In such a three- 
dimensional systolic array, all adjacent processing elements along all three dimensions are mutually 
coupled for systolically processing and transferring the matrix and vector signal subsets. Whereas the quasi 
three-dimensional systolic array of Figure 8A requires T + K-1 processing cycles to produce the product 
outputs 0|, a fully three-dimensional systolic array in accordance with the present invention requires only 
approximately P(P + 1)(2P + 1)/12 processing cycles (for P = Q = T). 

Referring to Figure 18, a block diagram of a three-dimensional systolic processing array in accordance 
with the present invention for P = Q = T = 3 is illustrated. Pipelining is done in all three dimensions 
simultaneously as shown. The matrix W P1t W^, Wpa and vector V P1 , Vpz, Vpg signal subsets are inputted to 



10 



EP 0 479 102 A2 



three perpendicular planes of processing elements. As in the two-dimensional case discussed above, the 
corresponding matrix and vector signals are inputted into their respective processing elements sequentially, 
multiplied and accumulated therein. The remaining corresponding matrix and vector signals are then 
systolicaliy transferred to subsequent processing elements plane-by-plane-by-plane throughout the three- 
dimensional processing array. 

It will be recognized that the "cube" to which the corresponding matrix and vector signals are 
transferred becomes smaller by one processing element on all sides. For example, starting at a corner 
processing element Ni j1(1l the matrix W P1 , Wp2, W P3 and vector V P1) Vpa, Vp3 signaJ subsets are initially 
inputted to three perpendicular planes of processing elements. The matrix and vector signals are then 
systolicaliy transferred to subsequent processing elements plane-by-plane-by-plane throughout the three- 
dimensional processing array, with a new "corner" processing element N 2(2i2 located one processing 
element in from the initial corner processing element N 1t11 . 

Hence, it can be seen from the foregoing that a multidimensional systolic array processor in accordance 
with the present invention provides improved processing speed due to the full multidimensionality of its 
processing element interconnections, improved global interconnectivity (e.g. by requiring external connec- 
tions to only one row and one column of the two-dimensional array), and reduced local storage require- 
ments by avoiding the unnecessary transferring and local storage of unneeded matrix signals. 

It should be understood that various alternatives to the embodiments of the present invention described 
herein can be employed in practicing the present invention. It is intended that the following claims define 
the scope of the present invention, and that structures and methods within the scope of these claims and 
their equivalents be covered thereby. 

Claims 

1. A multidimensional systolic array processor comprising: 

a signal processing array systolicaliy coupled in' a PxQ matrix having P rows and Q columns of 
processing means N AiBi where Ae{1,2,3,...,P} and Be{1,2,3,...,Q}, to systolicaliy process a matrix signal 
set W having matrix signals W w and a vector signal set V having vector signals Vj, where le*- 
{L 2 - 3 M ) and Je{1,2,3 K}, said matrix signal set W representing a matrix parameter set selec- 
tively represented as an MxK matrix having M rows and K columns of parameters, and said vector 
signal set V representing a vector parameter set selectively represented as a K-element vector having 
K parameters, wherein each processing means N 1B in a first one of said rows of processing means 
N a ,b is coupled to receive a vector column signal subset V c of said vector signal set V, where 

V c = V Y(Z = Vj 
where: 

Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

Z = 1,2,3 Q 

Y= X.X + 1.X + 2 P 

X = Z, for odd Z 

= Z + 1 , for even Z. 

2. An array processor as recited in Claim 1, wherein each processing means N A(1 in a first one of said 
columns of processing means N A>B is coupled to receive a vector row signal subset V R of said vector 
signal set V, where 

V R = V YiZ = Vj 

where: 
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Y 

j « Z-Y-Q + £ (Q-Y+2) 
Y=l 

Y = 1,2,3 P 

Z = X.X + 1.X + 2 Q 

X = Y, for even Y 

= Y+1,forodd Y. 

An array processor as recited in Claim 1, wherein said systolic coupling of said processing means N^b 
comprises individually coupling each processing means Na, b in each row with a corresponding 
processing means N A .i iB in a preceding row via a vector column subset signal line Uc<a.i) and a matrix 
column subset signal line Lwqa-i), and individually coupling each processing means N AB in each row 
with a corresponding processing means N A+liB in a subsequent row via a vector column subset signal 
line Lvc(A*i) and a matrix column subset signal line L W c(A+i)- 

An array processor as recited in Claim 2, wherein said systolic coupling of said processing means N A , B 
comprises individually coupling each processing means N^b in each column with a corresponding 
processing means N AiB .i in a preceding column via a vector row subset signal line U^b-d and a matrix 
row subset signal line Lwr^d, and individually coupling each processing means N A)B in each column 
with a corresponding processing means N A[B+1 in a subsequent column via a vector row subset signal 
line Lvr (B+ i, and a matrix row subset signal line L WR(B+1) . 

A multidimensional systolic array processor comprising: 

a signal processing array systoiically coupled in a PxQ matrix having P rows and Q columns of 
processing means N A , B , where Ae{1 ,2,3,...,?} and Be{1,2,3,...,Q}, to systoiically process a matrix signal 
set W having matrix signals W u and a vector signal set V having vector signals V J( where le«- 
{ 1 ' 2 > 3 M > and Je{1,2,3,...,K}, said matrix signal set W representing a matrix parameter set selec- 
tively represented as an MxK matrix having M rows and K columns of parameters, and said vector 
signal set V representing a vector parameter set selectively represented as a K-element vector having 
X parameters, wherein each processing means N 1(B in a first one of said rows of processing means 
N^s is coupled to receive a matrix column signal subset W c of said matrix signal set W, where 

W c = W A( b ;Y(2 

where: 

Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

2 = 1,2,3 Q 

Y = X,X + 1,X + 2,...,P 
X = Z, for odd Z 

= Z + 1, for even Z, 

and further wherein said matrix column signal subset W c is systoiically coupled row-to-row within said 
matrix of processing means Na,b, said coupled matrix column signal subset W c having fewer signals 
when coupled from one of said rows of processing means N AB to a subsequent row of processing 
means N A+1 B . 

An array processor as recited in Claim 5, wherein each processing means N Ai1 in a first one of said 
columns of processing means N AiB is coupled to receive a matrix row signal subset W R of said matrix 
signal set W, where 

W R = 

where: 
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Y 

J - Z-Y-Q + £ (Q-Y+2) 
Y«l 

Y = 1,2,3,...,P 

2 = X.X + 1.X + 2 Q 

X = Y, for even Y 

= Y + 1 , for odd Y, 

and further wherein said matrix row signal subset W R is systolically coupled column-to-column within 
said matrix of processing means N A(Bi said coupled matrix row signal subset W R having fewer signals 
when coupled from one of said columns of processing means N AiB to a subsequent column of 
processing means N A>B+1 . 

An array processor as recited in Claim 5; wherein said systolic coupling of said processing means N^b 
comprises individually coupling each processing means N^b in each row with a corresponding 
processing means N A . 1iB in a preceding row via a vector column subset signal line L vc <a.i) and a matrix 
column subset signal line L WC( a-i), and individually coupling each processing means N A(B in each row 
with a corresponding processing means N A+1iB in a subsequent row via a vector column subset signal 
line Ufc( A+1) and a matrix column subset signal line Lwc<a*i). 

An array processor as recited in Claim 6, wherein said systolic coupling of said processing means N AiB 
comprises individually coupling each processing means N A(B in each column with a corresponding 
processing means in a preceding column via a vector row subset signal line L V r ( b-i> and a matrix 
row subset signal line L WR ^B. t) , and individually coupling each processing means N A>B in each column 
with a corresponding processing means N AiB+1 in a subsequent column via a vector row subset signal 
line Ur{ B+ d and a matrix row subset signal line Ur(b + i>. 

A multidimensional systolic array processor comprising: 

a signal processing array systolically coupled in a PxQ matrix having P rows and Q columns of 

processing means N AiB , where Ae{1,2,3,...,P} and Be{1,2,3 Q}, to systolically process a matrix signal 

set W having matrix signals W tiJ and a vector signal set V having vector signals V J( where le— 
t 1 - 2 - 3 M } and Je{1,2 ) 3,...,K} l said matrix signal set W representing a matrix parameter set selec- 
tively represented as an MxK matrix having M rows and K columns of parameters, and said vector 
signal set V representing a vector parameter set selectively represented as a K-element vector having 
K parameters, wherein each processing means N 1iB in a first one of said rows of processing means 
N AtB is coupled to receive a vector column signal subset V c of said vector signal set V, where 

V c = V YtZ = Vj 

where: 



Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

Z = 1,2,3 Q 

Y = X,X+1,X + 2,...,P 
X = Z, for odd Z 

= Z + 1 , for even Z, 

and further wherein each processing means N 1(B in a first one of said rows of processing means N^b is 
coupled to receive a matrix column signal subset W c of said matrix signal set W, where 

W c = W AiB;Y)2 

where: 
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Z 

J = y-Z-P + £ (P-Z+2) 
Z«l 

5 

2 = 1,2,3, ...,Q 

Y = X.X + 1.X + 2 P 

X = Z, for odd Z 

= Z + 1 , for even Z, 

w and still further wherein said matrix column signal subset W c is systolically coupled row-to-row within 
said matrix of processing means N AiBt said coupled matrix column signal subset W c having fewer 
signals when coupled from one of said rows of processing means to a subsequent row of 
processing means N A+1B . 



10. 



An array processor as recited in Claim 9, wherein each processing means N Ail in a first one of said 
columns of processing means N AiB is coupled to receive a vector row signal subset V R of said vector 
signal set V, where 



20 



V R = V Yt2 = Vj 
where: 



Y 

25 J = Z-Y-Q + £ (Q-Y+2) 

Y=l 

Y = 1,2,3 P 

Z= X,X+1,X + 2,...,Q 
30 x = Y, for even Y 

= Y + 1,forodd Y. 

11. An array processor as recited in Claim 10, wherein each processing means Na,, in a first one of said 
columns of processing means N AiB is coupled to receive a matrix row signal subset W R of said matrix 
35 signal set W, where 

W R = \N KB;yz 

where: 



y 

J = Z-Y-Q + £ (Q-Y+2) 
Y=l 

Y = 1,2,3 P 

Z = X.X + 1.X + 2 Q 

X = Y, for even Y 

= Y+1,forodd Y, 

and further wherein said matrix row signal subset W R is systolically coupled column-to-column within 
said matrix of processing means N A , Bi said coupled matrix row signal subset W R having fewer signals 
when coupled from one of said columns of processing means N A>B to a subsequent column of 
processing means N^s+t. 

12. An array processor as recited in Claim 9, wherein said systolic coupling of said processing means N AB 
comprises individually coupling each processing means Na, b in each row with a corresponding 
processing means N A . 1(B in a preceding row via a vector column subset signal line L^a.,, and a matrix 
column subset signal line Lwc(a-i), and individually coupling each processing means N AB in each tow 
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with a corresponding processing means N A+1 , B in a subsequent row via a vector column subset signal 
line Lvc(A + i) and a matrix column subset signal line U,c<a + i). 

13. An array processor as recited in Claim 10, wherein said systolic coupling of said processing means 
N a ,b comprises individually coupling each processing means N A<B in each column with a corresponding 
processing means in a preceding column via a vector row subset signal line Lvr ( b-i) and a matrix 
row subset signal line Ur^„, and individually coupling each processing means N AiB in each column 
with a corresponding processing means IV B+1 in a subsequent column via a vector row subset signal 
line I_vr {B+ 1) and a matrix row subset signal line U^b* 

14. An array processor as recited in Claim 1 or 9, wherein each one of said processing means B in said 
first row of processing means N A(B is coupled to receive said vector column signal subset V c 
substantially simultaneously. 

15. An array processor as recited in Claim 2 or 10, wherein each one of said processing means N A1 in said 
first column of processing means N AB is coupled to receive said vector row signal subset V R 
substantially simultaneously. 

16. An array processor as recited in Claim 5 or 9, wherein each one of said processing means N," B in said 
first row of processing means N AiB is coupled to receive said matrix column signal subset W c 
substantially simultaneously, 

17. An array processor as recited in Claim 6 or 10, wherein each one of said processing means N A1 in. said 
first column of processing means N AiB is coupled to receive said matrix row signal subset W R 
substantially simultaneously. 

1a An array processor as recited in Claim 1 or 5 or 9 t wherein each one of said processing means N AB 
comprises a multiplier-accumulator. 

19. An array processor as recited in Claim 18, wherein said multiplier-accumulator comprises a digital 
adder and a digital register. 

20. An array processor as recited in Claim 1 or 5 or 9, wherein each one of said processing means N AB 
comprises a plurality of digital registers. 

21. A method of systolically processing a plurality of signal sets, comprising the steps of: 

(a) providing a signal processing array systolically coupled in a PxQ matrix having P rows and Q 
columns of processing means N AtB , where Ae{1,2,3 P} and Be{1,2,3 Q}; 

(b) coupling into said processing array a matrix signal set W having matrix signals W u representing 
a matrix parameter set selectively represented as an MxK matrix having M rows and' K columns of 
parameters, where le{1,2,3,...,M} and Je{1,2,3,...,K}; 

(c) coupling into said processing array a vector signal set V having vector signals Vj representing a 
vector parameter set selectively represented as a K-element vector having K parameters, wherein a 
vector column signal subset V c of said vector signal set V is coupled into each processing means 
N 1>B in a first one of said rows of processing means N AiB , where 

V c = V Yt2 = Vj 

where: 



2 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

2 = 1,2,3 Q 

Y = X,X + 1,X + 2,...,P 
X = 2, for odd 2 
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= Z + 1 , for even 2; and 
(d) systolically processing said matrix W and vector V signal sets. 

22. A method of systolically processing a plurality of signal sets, comprising the steps of: 

(a) providing a signal processing array systolically coupled in a PxQ matrix having P rows and Q 
columns of processing means N AiB , where Ae{1,2,3,...,P} and B<={1 ,2,3,..,Q}; 
<b) coupling into said processing array a matrix signal set W having matrix signals W, j representing 
a matrix parameter set selectively represented as an MxK matrix having M rows and* K columns of 

parameters, where le{1,2,3 M} and Je{1,2,3,...,K}, wherein a matrix column signal subset W c of 

said matrix signal set W is coupled into each processing means N 1(B in a first one of said rows of 
processing means N AiBt where 

W c = W AiB:Y(2 

where: 



Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

Z = 1,2,3,. .,G 

Y= X,X+1,X + 2,...,P 

X = Z, for odd Z 

= Z + 1 , for even Z, 

and further wherein said matrix column signal subset W c is systolically coupled row-to-row within 
said matrix of processing means N AiB , said coupled matrix column signal subset W c having fewer 
signals when coupled from one of said rows of processing means to a subsequent row of 
processing means N A+1(B ; 

(c) coupling into said processing array a vector signal set V having vector signals Vj representing a 
vector parameter set selectively represented as a K-element vector having K parameters; and 

(d) systolically processing said matrix W and vector V signal sets. 

A method of systolically processing a plurality of signal sets, comprising the steps of: 

(a) providing a signal processing array systolically coupled in a PxQ matrix having P rows and Q 
columns of processing means N AB , where Ae{1,2,3,..,P} and Be{1 ,2,3,...,Q}; 

(b) coupling into said processing array a matrix signal set W having matrix signals W,j representing 
a matrix parameter set selectively represented as an MxK matrix having M rows and' K columns of 
parameters, where le{1,2,3,...,M} and Je{1 ) 2,3,...,K}, wherein a matrix column signal subset W c of 
said matrix signal set W is coupled into each processing means N,. B in a first one of said rows of 
processing means N A B , where 

Wc = W A)B:YiZ 

where: 



Z 

J = Y-Z-P + £ (P-Z+2) 
Z=l 

Z = 1,2,3 Q 

Y= X,X + 1,X + 2 P 

X = Z, for odd Z " 

= Z + 1 , for even Z, 

and further wherein said matrix column signal subset W c is systolically coupled row-to-row within 
said matrix of processing means N AB , said coupled matrix column signal subset W c having fewer 
signals when coupled from one of said rows of processing means N AB to a subsequent row of 
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processing means N A+1B ; 

(c) coupling into said processing array a vector signal set V having vector signals Vj representing a 
vector parameter set selectively represented as a K-element vector having K parameters, wherein a 
vector column signal subset V c of said vector signal set V is coupled into each processing means 
N 1i0 in a first one of said rows of processing means N AB , where 
V c = V YrZ = Vj 



where: 



Z 

J = Y-Z-P + £ (P-2+2) 
Z»l 

Z = 1,2,3, ...,Q 

Y = X.X + 1.X + 2 P 

X = Z, for odd Z 

= Z + 1, for even Z; and 
(d) systolically processing said matrix W and vector V signal sets. 

I. A processing method as recited in Claim 22 or 23, wherein said step of (b) coupling said matrix signal 
set W into said processing array further comprises coupling a matrix row signal subset W R of said 
matrix signal set W into each processing means N AJ in a first one of said columns of processing 
means N^b, where 

W R = W WiZ 

where: 



Y 

J = Z-Y-Q + £ (Q-Y+2) 
Y=l 

Y = 1,2,3,... ,P 

Z = X,X + 1,X + 2,.„,Q 
X = Y, for even Y 

= Y + 1.for odd Y, 

and further wherein said matrix, row signal subset W R is systolically coupled column-to-column within 
said matrix of processing means N AtB , said coupled matrix row signal subset W R having fewer signals 
when coupled from one of said columns of processing means N A(B to a subsequent column of 
processing means Na,b-h. 

25. A processing method as recited in Claim 22 or 23, wherein said step of (b) coupling said matrix signal 
set W into said processing array further comprises coupling said matrix column signal subset W c into 
each one of said processing means N 1(B in said first row of processing means H* B substantially 
simultaneously. 

26. A processing method as recited in Claim 24 wherein said step of (b) coupling said matrix signal set W 
into said processing array further comprises coupling said matrix row signal subset W R into each one of 
said processing means Na,, in said first column of processing means Na. b substantially simultaneously. 

27. A processing method as recited in Claim 21 or 23, wherein said step (c) of coupling said vector signal 
set V into said processing array further comprises coupling a vector row signal subset V R of said vector 
signal set V into each processing means N A)1 in a first one of said columns of processing means N A(B , 
where 

V R = Vv 2 = Vj 
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where: 



Y 

J = Z-Y-Q + £ (Q-Y+2) 
Y»l 

Y = 1,2,3,...,P 

2 = X,X + 1,X + 2,...,Q 

X = Y ( for even Y 

= Y + 1, for odd Y. 

2a A processing method as recited in Claim 21 or 23, wherein said step (c) of coupling said vector signal 
set V into said processing array further comprises coupling said vector column signal subset V c into 
each one of said processing means N liB in said first row of processing means substantially 
simultaneously. 

29. A processing method as recited in Claim 27, wherein said step (c) of coupling said vector signal set V 
into said processing array further comprises coupling said vector row signal subset V R into each one of 
said processing means N A(1 in said first column of processing means N AfB substantially simultaneously. 
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